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FOREWORD 


This  paper  establishes  properties  of  the  optimal  decision 
rules  for  a  particular  class  of  chance-constrained  programming 
problems.  The  type  of  problem  considered  is  an  n- period  model 
in  which  each  period  generates  exactly  two  constraints.  One  of 
these  constraints  couples  the  decision  rule  of  the  |th  period  to  the 
decision  rules  of  all  succeeding  periods,  while  theother  is  a  con¬ 
straint  requiring  the  decision  rule  to  be  nonnegative  with  at  least 
a  specified  probability.  Necessary  and  sufficient  conditions  for 
optimality  are  derived  and  related  to  results  in  the  calculus  of 
variations. 

One  application  of  the  mathematical  developments  presented 
in  this  paper  is  described  in  RAC-P-12,  “Application  of  Chance- 
Constrained  Programming  to  Solution  of  the  So-Called  ‘Savings 
and  Loan  Association’  Type  of  Problem." 
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Optimal  Decision  Rules  for 
the  Triangular  E  Model 
of  Chance-Constrained  Programming 


ABSTRACT 


This  paper  deals  with  an  h -period  E  model  of  chance- 
constrained  programming  in  which  each  period  i  -  1,  .  .  . ,  n 
generates  exactly  one  new  constraint.  It  is  shown  that  there 
are  cases  in  which  the  problem  can  be  reduced  to  one  of  sol¬ 
ving  n  rather  simple  one -variable  nonlinear  programming 
problems. 

The  results  of  this  paper  are  illustrated  by  means  of 
an  example  giving  the  solution  of  a  two-period  problem  of 
planning  for  liquidity  In  a  savings  and  loan  association. 
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1.  INTRODUCTION 


In  a  previous  paper1  the  authors  established  certain  necessary  conditions 
for  decision  rules  to  be  optimal  for  the  block  triangular  n -period  E  model  of 
chance-constrained  programming.  This  paper  is  concerned  with  a  more  re¬ 
stricted  problem  than  the  one  considered  in  RAC-TP-166.1  In  particular  an 
n-period  E  model  is  considered  in  which  each  period  i  -  1,  .  .  .  ,n  generates 
exactly  one  new  constraint  rather  than  m,  new  constraints  as  in  the  earlier  paper. 

This  restriction  leads  to  a  problem  that  is  easier  to  handle  mathematically 
than  the  more  general  case  considered  in  RAC-TP-166,'  about  which  much  more 
can  be  said.  In  fact,  in  certain  cases  the  problem  can  be  reduced  to  one  of  solv¬ 
ing  n  rather  simple  one- variable  nonlinear  programming  problems.  Moreover, 
in  the  event  that  each  of  the  random  variables  involved  in  the  problem  has  the 
same  distribution,  the  complete  n-stage  problem  can  be  reduced  to  solving  one 
of  these  simple  nonlinear  problems. 

In  addition,  two  generalizations  of  the  problem  in  RAC-TP-1661  are  con¬ 
sidered  here.  First,  instead  of  having  the  i  th  constraint  be  of  the  form 


which  would  be  the  triangular  version  of  the  block  triangular  it -period  problem, 
the  ith  constraint  is  allowed  to  be  of  the  form 

. ‘.-I'-")  -  V 

where  d,  is  a  constant  and  cc,  ( i>, ,  .  .  .  ,b,  , )  is  an  arbitrary  piecewise  continuous 
function  of  the  random  variables  b,,  .  .  .  ,b,  Second,  the  nonnegativity  con¬ 
straints  \,  ■»  0,  |  -  1,  .  .  .  ,n,  used  in  RAC-TP-1661  are  replaced  by  the  more 
general  constraints  P(\(  -  0)  •»  0  ,,  |  -  1, .  .  .  ,  n  ,  where  0,  is  some  prcassigned 
probability. 

The  effect  of  this  second  generalization  is  discussed  at  length.  It  is  shown 
that  restricting  \,  to  be  nonnegative  only  100  0,  percent  of  the  time,  rather  than 
all  the  time  as  was  done  in  RAC-TP-1661,  greatly  increases  the  mathematical 
complexity  of  the  problem.  In  addition  the  interesting  result  is  derived  that 
when  such  a  constraint  is  tight,  the  optimal  rule  is  often  discontinuous  where 
it  was  previously  continuous.  From  other  points  of  view  ,  this  result  is  to  be 
anticipated.  For  example  (S,s)  policies;’  when  optimal,  in  inventory  theory  have 
this  property,  as  do  many  solutions  of  optimal  control  problems. ' 

The  simplification  that  results  when  all  the  preassigned  probabilities  are 
equal  to  1  is  also  illustrated.  In  this  case  the  optimal  decision  rule  for  period  i 
is  a  piecewise  linear  function  of  the  decision  rules  of  periods  1,  .  .  .  ,i  1,  and 
the  pieces  can  be  easily  found. 
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An  example  of  the  application  of  the  results  of  this  paper  to  a  problem  in 
financial  planning  is  contained  in  Charnes  and  Kirby,4  which  gave  a  solution  of 
a  two- period  problem  of  planning  for  liquidity  in  a  savings  and  loan  association 
In  this  model  the  fact  that  the  optimal  decision  rule  is  in  general  discontinuous 
is  surprising,  but  it  can  be  explained  by  economic  arguments. 


2.  STATEMENT  OF  THE  PROBLEM 

The  problem  to  be  considered  is: 
maximize 

£  C(r  y 
i*l  1  1 

subject  to 

IM  u 1 1  \ j  ♦  d,  b,  ♦  bij  i  0)  2  , 

i  (  (I  r)  |  \  |  ♦  (J  r)1  \|)  ♦  (i  I)  b  rf  ♦  (iJiy  (  b  J  )  •  0)  Cl  2  * 

*  UJ2^2  1  a33'\l  *  “*3b3  *  <u3(b|,b2>  -  °)  -  ^3  ■ 


*  -v*. . s  °)*  v 


K,*,  V\  1  . b"-i)  ^  °)  -  V 

FIX,  -  0)  j  pr  ,  ,  1 . n ,  (1) 

where  P  and  E  represent  the  probability  and  expectation  operators,  respectively. 
The  probability  and  expectation  is  computed  by  using  the  joint  distribution  of  all 
the  random  variables  involved  in  the  problem. 

In  Problem  1  the  following  assumptions  are  made: 

(a)  a,,  ,  i  >  j  ,  i ,  j  -  1,  .  .  .  dit  c,  ,i  =  1,  .  .  .  ,*i,  and  w,  are  given  constants, 
and  a,,  i  0,  d,  t  0  for  all  i . 

(b)  0f  ,i  ,  j  =  1,  .  .  .  ,n  are  known  probabilities.  Thus  0  *  a,,  *  1  for 

all  i  and  j . 

(c)  the  b,  ,  i  =  1,  .  .  .n  are  continuous  random  variables  whose  joint  fre¬ 
quency  function  f„(b  t,  .  .  .  ,b„)  is  known. 

(d)  X  ,  |  -  1, .  .  .  ,n  is  a  function  of  the  random  variables  bi,  .  .  .  ,  bj_ , 
but  it  is  not  a  function  of  b(,.  .  .  ,b„  .  Thus  we  will  solve  Eq  1  for  Xj  -  X| 

( b i,  .  .  .  ,bj_|). 

In  Sec  5  we  will  consider  the  more  general  problem  that  arises  when 
we  allow  c , ,  .  .  .  ,c„  to  be  random  variables  rather  than  constants  as  they  are 
in  assumption  a.  However,  since  some  of  the  work  in  Sec  3  does  not  extend 
to  this  case  we  will  for  the  moment  assume  that  c,,  j  =  1,  .  .  .  ,n  are  given 
constants. 


4 


Assumption  d  is  due  to  our  interpretation  of  the  problem.  We  are  going 
to  treat  Problem  1  as  an  «- period,  or  «  -  stage,  problem  in  which  X, ,  the  de¬ 
cision  rule  for  the  jth  period,  is  selected  after  all  previous  decisions  X!,.  .  .  ,X(_, 
are  known  and  after  the  values  of  the  random  variables  of  periods  1  toj  -  1 
have  been  observed  but  before  b(  and  all  random  variables  and  decisions  of 
periods  j  *  1  to  n  have  been  observed 

In  other  words,  Xi,  the  first-period  decision  rule,  must  be  selected  before 
the  value  of  the  first-period  random  variable  b,  is  observed.  Then,  when  we  have 
selected  X!  and  observed  b,,  the  second-period  decision  rule  X2  must  be  chosen 
before  the  value  of  b2  is  observed.  This  process  continues  with  X,  depending 
explicitly  on  X, ,  b, ,  i  =  1,  .  .  .  ,  j  -  1  and  only  implicitly  (i.e.,  through  the  coupling 
effect  of  the  constraints)  on  bj  and  X, ,  b, ,  i  =  j  + 1,  .  .  .  ,n.  It  is  this  interpretation 
that  led  us  to  make  assumption  d. 

The  set  Q, ,  i  =  1,  .  .  .  ,n,  in  i-dimensional  Euclidean  space  is  defined  as 
the  set  of  points  (b,f  .  .  .  ,b,)  for  which  f,(  b,,  .  .  .  ,b,)  >  0,  where  f,(bi,  .  .  .  ,b,) 
is  the  joint  frequency  function  of  bw  .  .  .  ,b,.  Since  we  have,  by  definition  of 
fj ( b i ,  .  .  .  ,b,) ,  the  identity 

Mhi . V  /'••  •/?„<!> |.  "diy 

—  <*»  —'V  j  e  |  ♦  1  > 

it  may  be  seen  by  assumption  c  that  f,  (kt ,  .  .  .  ,!>,)  is  a  known  function.  It  is 
important  to  note  that  no  restriction  on  Q,  as  a  bounded  set  has  been  made. 

Thus  it  may  extend  to  ±  *  in  any,  or  all,  of  its  i  dimensictis. 

F,  (.)  is  used  to  represent  the  multivariate  cumulative  distribution  function 
of  the  random  variables  b,,  .  .  .  ,b,.  We  will  write 

F,(G)  /..../ f,(h, . b.idb,.  .  .  Jb, , 

(l 

where  G  is  any  subset  of  i-dimensional  space. 

One  more  restriction  must  be  placed  on  our  problem  in  order  that  the 
differential  equations  method  of  the  isoperimetric  theory  of  the  calculus  of 
variations  may  be  used. 


Assume  that  for  each  s,  s  =  2,  .  .  .  ,n,  there  exists  a  set  of  s  -  1  dimen¬ 
sional  rectangles,  say  {A^-1,  tci’s_IJ,  where  i’s~‘  is  some  indexing  set,  such  that 


U) 

Q  s- 

.  c  j 

t, i’*-1  ( 

1  .where 

Qs- 

,  is  the  closure  of  Qs_, , 

(ii) 

F- 

,  ( A -p - 1 )  >  o,  for  all  rc 

s-  1 

(iii) 

V 

4  s*— 

.  <Asfe-‘  n  A-r1) 

=  0 , for 

all 

k,  t  ci's-1  and  k  *  c, 

(iv) 

f,-l 

1  *  's^ss^s 

S-  1 

+  E  a  ) 

i  i  -sl 

s  * 

u)s ) ,  ,\( .  |  1 ,  .  .  ,  s  -  1  and  X*  are  con 

tinuous  in 

As- 

1  for  all  i's- 

1  1 

-  1 

lv) 

X* 

is  of  constant 

sign  in  A 

v-  1 

1' 

for  all  if  i  '~ 1 . 

where  fs(.)  is  the  conditional  frequency  function  of  bs  given  b , ,  .  .  .  ,bv  ,  and 
X*  is  an  optimal  Xs  for  1. 

i,  ii,  and  iii  say  that  {  Ajp‘,  t-e  V-S-'J  divides  Qs_,  into  a  set  of  s  -  1 
dimensional  rectangles  such  that  the  probability  that  a  random  point  ( b , ,  .  .  ., 
bs_i)  in  Qs_iis  in  any  one  of  these  rectangles  is  greater  than  zero,  and  the 
probability  that  (b i,  .  .  .  ,bs_,)  is  in  the  intersection  of  any  two  rectangles  is 
zero.  In  both  cases  the  probability  is  computed  using  the  frequency  function 


fs_,(b,t  .  .  .  ,bs_,).  Moreover,  using  well-known  properties  of  any  distribution 
function  (i.e.,  for  discrete  or  continuous  random  variables),  it  is  easy  to  show, 
using  properties  ii  and  iii,  that  there  is  at  most  a  countable  number  of  rectangles 
A'jr 1  with  '  cVs-‘. 

It  is  always  possible  to  find  {Ajp1 ,  f  e  V s - 1 1  with  properties  i,  ii,  and  iii  and 
such  that  fs_,  is  continuous  in  each  Ajr‘.  It  follows  then  that  an  assumption 
equivalent  to  iv  would  be  that  X, ,  j  =  1,  .  .  .  ,n,  and  uijfb, ,  .  .  .  ,bj_,),  j  - 1, .  .  . ,  n 
are  each  continuous  functions  with  a  countable  number  of  discontinuities.  Thus 
iv  does  not  restrict  our  problem  to  any  significant  degree. 

It  is  important  to  realize  that  the  set  of  rectangles  {A*,-* ,  '(  V>S~M  defined 
above  depends  critically  on  X* .  In  other  words,  there  may  well  exist  other 
feasible  (but  not  necessarily  optimal)  decision  rules  for  Problem  1  that  would 
generate  a  covering  of  Qs_,  different  from  the  one  given  by  (Ajp1,  How¬ 

ever,  because  the  chief  concern  is  with  deriving  necessary,  rather  than  sufficient, 
conditions  for  X*  ,  only  [  A sf- 1 ,  tei’*-1},  henceforth  referred  to  as  the  “optimal 
partition”  of  Qs _ , ,  is  considered. 

It  must  also  be  emphasized  that  X*  ,  an  optimal  Xs,  is  not  necessarily 
unique.  That  the  solution  of  Problem  1  is  not  unique  follows  from  the  fact  that 
any  other  decision  rule  X's  that  is  such  that  •  •  •  .  'fs_,db, .  .  .dbs_,  -  0,  where 
A  fib, ,  .  .  .  ,bs_,)  :  Xj  *  X*s  ],  will  satisfy  the  constraints  of  Problem  1  and  have 
csE(.X<)  -  csE(.X*)>  Hence  \\f  wili  also  be  optimal  for  Problem  1;  i.e.,  the  optimal 
decision  rule  for  Problem  1  is,  in  general,  nonunique— at  least  on  a  set  of  meas¬ 
ure  zero.  This  trivial  nonuniqueness  can  of  course  be  avoided  by  adopting  a 
convention  such  as  making  X*  right  (or  left)  continuous.  However,  this  is  not 
the  only  kind  of  nonuniqueness  that  can  occur.  In  Sec  6  a  situation  is  illustrated 
in  which  the  optimal  rule  fails— in  a  very  significant  way— io  be  unique.  In  fact 
the  situation  is  such  that  two  optimal  rules  could  fail  to  be  equal  for  every  point 
(b,,  .  .  .  , b^_| )fQ$-i  , 

In  order  to  solve  Problem  1,  rewrite  the  ith  constraint  using  assumption  a. 


1  •  d,b,  • 

■  h,-i 

)  1 

'  UH 

1  \ 

V  \ 

1  <1,  ’ 

•  r  '■*•) 

| .  for  di 

o. 

1  “ll 

i  > 

N  —  \ 

1  J.  ' 

<  "■/ 

).  for  J, 

0  . 

let 


Let  I  1 


Then 


be  the  set  over  which 


i  U  '  \ 

.  I  "  • 


I. . .  . .  Jh„>. 

1 1 


by  our  interpretation  of  the  I’  operator. 
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By  assumption  d,  X,  is  only  a  function  of  b,,  .  .  .  and  so  the  set  P 
depends  only  on  bi,  .  .  .  ,b, .  Hence  the  above  integration  can  be  performed 
first  with  respect  to  b, ,  j  -i  *  1,  .  .  »  and  then  with  respect  to  b, ,  j  =  1, 

.  .  .  ,i .  But  integrating  with  respect  to  b|t  j  =  i  *  1,  .  .  .  we  are  integrating 
the  joint  frequency  function  of  the  various  random  variables  over  their  entire 
range  of  possible  values  (i.e.,  over  all  the  values  that  they  can  take  on  with 
nonzero  probability).  Since  the  value  of  this  integral  is  1, 

/•| .  •  /  f,<f b,  . . .  -  /.  „  .  /  f,db,  . . .  J t»,  - 


vi-i 


,dh, 


db. 


where  F,(.)  is  the  conditional  distribution  function  of  b,  given  bi,  .  .  .  ,b,_,. 
This  last  equation  is  obtained  by  holding  b!t  .  .  .  ,b,..,  fixed  and  integrating  over 
P  with  respect  to  b, . 

Similarly  for  d,  <  0 


<i  y.,«, 

'i  - 1 


d  b 


.  o) 


I  -  r.(-  i  -*N(-^)i1_,Jb,  ...db,_, 

0,-i  V  ’ 


Ek,\,)  f,E(Xj)  -  f  /X,  f„<tb,  ..  JbB  «,/L.../X,f|.|«1  • 

u*  Q,- 1 

Therefore  Problem  1  can  be  written  in  the  following  form: 
maximize 

subject  to 

^  «d.) \l-.,')f,_ldb1  ...db,_,  >  a,\.  . . 

t\  '  > 


IM\(  >0)  i  . «. 


(2) 


where 


a* 


a(  if  »j«i  (d,f  *  ♦  I  (i.e.,  if  d,  >  0) 
a(  -  I  if  fcjtn  <d,f  «•  -  I  (i.e..  if  d(  Of  . 


and  by  Q„  is  meant  th  t  we  perform  no  integration  but  just  get  c  i  \t  in  the  ob¬ 
jective  function  and  sgn  ( <1 , j  F,  (-  a X,  -  u:' )  '  in  the  constraints. 

For  convenience,  fix  on  certain  choices  of  sign  for  some  of  the  constants 
involved  in  Problem  1  to  carry  forward  the  mathematical  arguments.  Only  a 
simple  formal  exchange  must  be  made  in  order  to  encompass  the  other  possible 
choices  of  sign  into  our  results.  It  is  assumed  that  d,  <  0,  t,  >  0,  a„  >  0  for 
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i  -  1,  ...  ,n.  By  defining  a(|  -  a ,  and  u -  cu,'  Problem  2  can  be  written  as 

maximize 

.“,‘i  1  -  ■  ■  1  ■  ■  ■  Jh,-i 

V. 

subject  to 

■  •  I  ',(  i-,  “,V\  •  /,_|  db,  ■  Jh,_,  -  1  *  V  I . " 

^.-1 

fx,  -  <"  -  t\.  i  -i . "  (3) 

For  the  sake  of  notational  convenience  the  primes  will  be  dropped  from 
a*  and  w"  throughout  the  remainder  of  the  paper.  Moreover,  the  region  of  in¬ 
tegration  will  no  longer  be  explicitly  written  out,  but  it  will  be  implicitly  under¬ 
stood  that  when  we  integrate  using  the  frequency  function  f,_,  i  -  2,  .  .  .  ,n  the 
region  of  integration,  unless  otherwise  stated,  is  Q,_ j  . 

Finally,  assume  in  what  follows  that  |c,E(X*j  |  <  »,  j  -  1,  .  .  .  ,it  and  that 
there  exist  decision  rules  Xj,  j=  1,  .  .  .  ,n  that  are  feasible  for  Problem  3. 
Various  ways  of  modifying  a  chance-constrained  problem,  when  the  constraints 
are  inconsistent  or  the  optimal  value  of  the  objective  function  is  unbounded, 
are  discussed  at  length  in  a  previous  paper.’ 


3.  SOLUTION  OF  THE  Sth  SUBPROBLEM 

By  the  Sth  subproblem  the  following  is  meant: 
maximize 

l,  )■  ■  ■  ■  i  V  ls-ldhl  •  Jbs-I 

subject  to 

I’(\S  .  o >  _  ft,  .  (4) 


In  Problem  4  it  is  assumed  that  \(  ( blt  .  .  .  ,t>M),  j  -  1,  .  .  .  ,s-!  are  given 
functions  and  that  the  optimal  Xs(bt,  .  .  .  ,bN_,)  is  sought.  Furthermore,  it  is 
assumed  that  the  given  functions  \, ,  |  1,  .  .  .  ,s  -l,and  all  feasible  Xs  satisfy 

the  requirements  imposed  on  X, ,  |  -  1,  .  .  .  ,n  in  the  preceding  section.  Thus 
Problem  4  is  to  be  solved  for  the  optimal  \s  as  a  function  of  ujs  and  the  given 
decision  rules  X ■ ,  .  .  .  ,  \ .  In  Sec  4  the  results  of  this  serdon  and  an  inductive 
argument  to  solve  the  n-period  Problem  3  are  used. 

Let  X*  be  an  optimal  solution  for  Problem  4. 
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Let 


/  •  ■  •  j  I  I  „  „ ,  \  *  •  i.  ^  u  \(  •  <  |  |  ii  h  |  .  .  .  J  t>  ,  _  |  .  f>»r  fin  (i  I'  i  V  '  *  . 

r  If:  \*  .  0  m  .  I  ,  V'-1  I  . 

I  '  If  \*  -  0  III  .  fr  V'-1  |  ■ 

Now  consider  the  following  localization  of  the  problem: 
maximize 


subject  to 

1  *  ,V'i\  •  " «">.-■  v  (5J 

r 

with  the  additional  constraint  that  Xs  --  0  if  'cl'and  Xs  »  0  it  '  (  !'  ■  Clearly, 
Lemma  1.  The  optimal  continuous  \\  for  Problem  5  is  X*|  1  ,  the  re¬ 

striction  of  X*  to  A-r1. 

Proof.  \* |  A|-‘  is  feasible  for  Problem  5  and  is  continuous  from  our 
definition  of  Ay  l.  Also  if  X*  |  Ay- 1  was  not  optimal  for  Problem  5,  then  X*  would 
fail  to  be  optimal  for  Problem  4,  since  on  A y- 1  its  contribution  to  the  objective 
function  of  Problem  4  could  be  improved. 

Lemma  1  shows  that  a  necessary  condition  that  X*  be  an  optimal  decision 
rule  for  Problem  4  is  that  for  each  Ay-1  ,  '  ( \*  be  the  optimal  continuous 
solution  for  Problem  5.  Further  necessary  conditions  on  Y*  are  now  obtained 
for  Problem  5,  using  variational  theory. 

Theorem  1 

A  necessary  condition  for  \*|Ajr‘  to  be  the  optimal  continuous  V  for 
Problem  5  is  that  for  each  point  (b,,  .  .  .  ,bs.,l  in  A'y either  X*(b(,  .  .  . 

0,  or  fs(ass  X*  *  E  j"  !  as|  X,  t  a's)  -  -  cs  A  uss  where  A  is  a  constant. 

Proof.  Let  '  d' .  Then  in  Problem  5  we  will  make  the  change  of  varial)le 
\s  Z~s.  The  following  problem  is  now  solved: 
maximize 


subject  to 

1  ;:i  i  -d,  \  •  •■.)(  (6, 

'r 

for  the  optimal  continuous  function  Z„(b,,  .  .  . 

Problem  6  is  a  multiple  integral  isoperimetrie  problem  in  the  calculus 
of  variations.  In  App  A  it  is  proved  that  the  assumptions  about  A^  1 ,  'fV  1 
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are  sufficient  for  the  derivation  of  the  Euler  equation  II  Zs  0,  where 
ll(b|,  .  .  .  ,b> _ 1 1  is  defined  by 

""•i . K  i1  •  *».(<•„:;  •  V«.,\  • 

and  X  -  0  is  a  constant. 

Since  the  Euler  equation  provides  a  necessary  condition  for  Z*  to  be  optimal 
for  Problem  6,  ll(Z*)  .  Zs  0  implies 

"•  (7) 

and  Eq  7  must  hold  for  all  points  in  A\r 1  . 

Since  any  point  (bu  .  .  .  ,bs_,)  for  which  fN_,  0  contributes  nothing  to  the 
objective  function  or  the  constraint  of  Problem  6,  only  points  for  which  fs_,  ■»  0 
will  be  considered.  Hence  we  conclude  from  Eq  7  that  at  such  points 

nllirr  Z*  -  0  . 

/  ,  .  \  -t  s 

nr  I  III  Z  *  •  -  <1  \  •  II.)  - - ,1  l  Iillsl.inl. 

'  \  -  I  f  1  7  Aiin< 

i.e., 

i-illi.i  \*  -  o  . 

-,r  I,  («.A*  •  -/C,'  '  ~  ~r~—  ■  (8bl 

Since  either  Eq  8a  or  Eq  8b  must  hold  for  every  point  in  Ajr 1 ,  the  theorem 
is  proved  for  tel'.  Since  a  similar  result  can  be  obtained  if  'c }',  the  theorem 
is  proved  for  all  ' f  Xs' 1 . 

The  set  of  rectangles  A',.-1,  ’  is  now  redefined  to  be  such  that,  in 

addition  to  having  properties  i-v  of  Sec  2,  they  also  have  the  property  that 
(vi)  either  X*  is  identically  zero  in  A',"  or  else 


where  Tj*  is  a  constant  such  that  there  exists  a  solution  Zlb)(  .  .  .  ,bs_,j  of  the 
equation  fs(Z*  T|.s*  for  each  point  (b,,  .  .  .  ,bs_i)f  AV  and  Z* ( b , ,  .  .  .  ,bs_,)  - 
f-‘(  Tf)  is  defined  for  each  point  (b|,  .  .  .  ,b,_,)  by  Z*(  b,,  .  .  .  ,bs_,j  max 
[  Z:fs(Z)  .  That  such  a  set  of  rectangles  exists  follows  from  the  fact 

that  in  each  Ay  1  defined  in  Sec  2  \t  is  continuous;  hence,  by  Theorem  1,  pach 
Ay  1  can  be  partitioned  into  a  set  of  rectangles,  say  \y‘  'r(KA(-  r,  such  that 

in  each  A^ ,  properties  i  to  v  and  property  vi  hold.  The  subscript  r  can  then 
simply  be  dropped  to  make  notation  easier.  Thus  Corollary  1  is  obtained. 

Corollary  1.  A  necessary  condition  that  X*  be  the  optimal  Xs  for  Problem 
4  is  that  there  exists  a  set  of  rectangles  { A'}~  ,  with  properties  i-vi. 


- ~ .  i, _ i  • ,  •  i .  ^ 
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Let  I  [  f :  X*  •  0  with  strict  inequality  for  some  points  in  A'(r'  >. 
Let  I  ft:  \*^  0  with  strict  inequality  for  some  points  in  A*,-*  L 
Let  K  ; ' :  X*  is  identically  zero  in  A}.~ 1  i. 

Consider  the  problem 
maximize 

i  —  I  ....  I  I,-1 1  I.'»  I.  I  Jl>,  ■  •  ./!>,  , 
r. 1. 1  "...  ,\j-i  'i-ii 


i'-*i.i ' ' 


- 1 


(9) 


subject  to 


I'M  \, 


- 1 


I  f 


.  (ir'< 


,<ihi 


,1  h 


I  - 


-  \ 


(9a) 


-  i.' 

1  I  1 


-  “  l\ 


.ill  1  h | . h,_,  I.  V-1  .irul  l,|.  (9b) 


t\-,‘  f|.'t  -  •  **s.  -II  •h, . •>„_,><  \v*'  »ui*i  |-,|  .  (9c) 

y  _  i(;  .  uyc.t,  r.  /  .  (9d) 

where  V(ls,  »J,S  are  constants  and 

'  rVy-i  V-'i ' 

V 

Problem  9  was  obtained  by  using  the  expression  for  \*  given  by  Corollary 
1.  Problem  9a  corresponds  to  the  first  constraint  of  Problem  4;  Problems  9b 
and  9c  express  the  fact  that  X*  •  0  in  A',.'1  for  7  r  I ,  and  \*  0  in  Af'1  for  '  c  / ; 

Problem  9d  gives  upper  and  lower  bounds  on  Tf  in  Af~  ,  which  assure  us  that 
f~‘(T|.  )  is  defined  in  Aj>  ,  i.e.,  that  there  exists  a  solution  of  f„(I)  Tf  for  each 
point  in  Af-1  for  'cl,  'c J . 

Now  find  Tf,  'cl,  'cj,  as  a  function  of  Af  and  thus  reduce  Problem  4  to 
determining  the  optimal  partition  {Af  ,  M’s'r. 

Clearly,  t 

Lemma  2.  If  ,  'cl,  'cj,  are  the  optimal  Tf  for  Problem  9. 

Proof.  Proceeding  exactly  as  in  the  proof  of  Lemma  1  easily  proves  that 
if  Tf  are  not  optimal  for  Problem  9,  then  a  contradiction  exists,  since  this 
implies  that  Xs  is  not  optimal  for  Problem  4. 

Using  the  fact  that  we  are  trying  to  find  Tj'*  as  a  function  of  Af'1  and  that 
f -’( .) ,  us,  and  Xj ,  |  1,  .  .  .  ,s-l  are  known  functions  of  bu  .  .  .  permits 

replacement  of  Problem  9b  and  Problem  9c  by  conditions  that  give  upper  and 
lower  bounds  on  f,:  .  Combining  these  new  bounds  with  Problem  9d  and  dropping 
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the  second  term  in  the  objective  function  of  Problem  9,  since  it  is  independent 

of  T/,  permits  writing  Problem  9  as 

maximize 

!  I  ■  ••  I  r  .IV'F'll.-iJh,  -  I -a,  -  '• 

i,i,l  \-  - 1  L  '  ■> 


subject  to 


L? 


n;,  f'i.  e>i . 


(10) 


where  L ?,  Uj>  are  constants. 

Employing  a  simple  Lagrange  multiplier  argument  makes  it  easy  to  estab¬ 
lish  that  a  necessary  condition  that  Tp  be  optimal  for  Problem  10  is  that  Tp 
take  on  one  of  the  three  values  L‘p ,  Up',  or  r* ,  where  Ts*  is  a  constant  that  does 
not  depend  on  >  and  so  Lp  ^  Ts*  -i  Up*  for  all  telj.  Moreover ,  sif  Tp**  is  equal  to 
Lp  or  Up*  ,  then  it  is  also  equal  to  Vps  or  Up  .  In  other  words,  Tp  cannot  equal 
the  bounds  on  Tp*  obtained  from  Problem  9b  or  Problem  9c  unless  these  bounds 
are  the  same  as  those  given  by  Problem  9d. 

Thus  Theorem  2  is  proved. 

Theorem  2 

There  exists  some  constant,  say  T **,  such  that  TpS*  takes  on  one  of  the  three 
values  Vp\  Up*,  or  Is*,  and  Vps  ■»  Ts*  •-  Up*  for  Id,  te  J. 

4.  THE  ..-PERIOD  PROBLEM 
Theorem  3 

A  necessary  condition  for  X*  ,  j  =  2,  .  .  .  to  be  optimal  decision  rules 
for  Problem  3  is  that  for  each  j  a  set  of  rectangles  [  Ap _  1 ,  Lci,s_l]  exists  with 
properties  i-vi  as  defined  above,  with  X,  replaced  by  X*  in  iv  and  vi. 

Proof.  The  theorem  is  proved  by  induction  on  t  where  s  -  n  +  1-t.  Begin 
by  proving  the  theorem  for  t  =  1,  i.e. ,  that  it  is  true  for  X*.  Then  assume  for 
induction  that  the  theorem  is  true  for  I  =  k,  i.e.,  for  X„_ktl,  .  .  .  ,X*  ,  and  then 
prove  it  is  true  for  t  k  ♦  1,  i.e.,  for  X* . 

Let  i  1. 

Let  X i ,  .  .  .  ,X„_i  be  feasible  decision  rules  for  the  first  n  -  1  periods. 

Then  the  problem  of  determining  X*  is  equivalent  to  solving  Problem  4  with 
s  tt .  Using  Corollary  1,  it  can  be  seen  that  Theorem  3  is  true  for  t  =  1. 

Assume  for  induction  that  the  theorem  is  true  when  t  =  k,  i.e.,  that  it  holds 
for  X*fet (  ,  .  .  .  ,  X*  .  Now  prove  the  theorem  is  true  for  t  =  k+  1,  i.e.,  for  X*  k. 

Using  the  induction  hypothesis,  the  expressions  for  X*_btl ,  .  .  .  ,X*  can  be 
put  into  the  objective  function  of 


Problem  3  to  get 


t-n-k-i  'Ip 


i-l  0 
i“l  1 


1-1 


<1-1 Jh. 


(11) 


12 


in  which  only  those  if!1)-1  for  which  X*_,  is  not  identically  zero  are  summed 
over.  By  integrating  Eq  11  with  respect  to  b,_,,  |  =  w-fc  +  1,  .  .  .  ,  n,  the  resulting 
integral,  with  respect  to  b,,  .  .  .  , b„ _ ), _ lt  is  such  that  the  integrand  is  a  piecewise 
linear  function  of  X*,  i  =  1,  .  .  .  ,n-k .  To  see  this  the  right-hand  side  of  Eq  11 
is  written  as 


M  -  fc  »! 


I  •  m  *  k  *  I 


1 1 .  i 


I,- lJhl 


where  k,,  is  a  constant  that  depends  on  the  various  a,,  .  However,  it  is  known 
that  Xf  is  a  function  of  only  bi,  .  .  .  , b,_ , ,  so  that  for  each  t  we  can  perform  the 
integration  in  the  first  term  of  expression  12  by  integrating  first  with  respect 

to  b . b(_,,  and  then  with  respect  to  b,,  .  .  .  , b,_ , .  Integrating  with  respect 

to  b, ,  .  .  .  ,b,_i,  yields  an  expression  for  the  first  term  of  expression  12  that 
is  of  the  form 

“  i  , _ ,  i‘f  . Jh,-i  ■  (12a) 

Hr 

i- 1  i- 1 

where  the  sets  B,.  result  from  integrating  over  the  various  Af  with  respect 
to  b, ,  .  .  .  , b,_ , ,  and  the  coefficients  depend  on  '  due  to  the  effect  of  integrat¬ 
ing  f/- it  with  respect  to  b, ,  .  .  .  , b,_ i ,  over  the  set  A1,."1. 

Now  suppose  that  Xt,  .  .  .  ,X„_(,_i  are  decision  rules  that  are  feasible  for 
the  first  n  -  k-1  periods.  Then  the  problem  of  finding  V)i  k  is  of  the  form 
maximize 


. m—  k 


i'.  v 


n  -  k  -  I  •' 


1  •  •  •  •  )  V.-k  fe-1  Jhl  •  •  • 


n-fc-l 


^  II— K 


subject  to 

-  !■■■■) 
,-f  yn-te-1  ^i»-fc-l 


/  "-*-1  \ 
^i-fe  ( 11  it—  k  ,  ii- It  ^ n—  h  *  **11—  I;  ,  |  \  *  *  *n— lc) 


..-l-l 

1  » .  -  i- 


(13) 


where  the  c"~k  depend  on  l,  as  explained  above.  However,  c"  is  constant  for 
each  >  and  hence  Problem  13  can  be  written  as  a  series  of  problems  tone  for 
each  'ci’”'*-'),  each  of  which  is  equivalent  to  Problem  5  with  s=n-k  and  <\ 
c"~k.  Hence  the  results  of  Corollary  1  can  be  applied  again,  and  hence  Theorem 
3  has  been  proved  for  t  =  k+  1. 

Therefore,  the  theorem  is  proved  by  induction. 

Corollary  2.  X* ,  |  =  1 ,  .  .  .  , n  is  a  piecewise  linear  function  of  oc,,  i  1,.  .  .  , 
and  f:‘(T|*),  .  =  1 _ ,j. 

Proof.  By  Theorem  3,  \*  is  either  zero  or  a  linear  function  of  \*„  k  1, 

.  .  .  ,|-1,  w, ,  and  f  ~  *(  Tp* ) ;  hence  it  is  a  piecewise  linear  function  of  a;,,  and 

f ~‘(  T1*) ,  a  id  Xj ,  k  =  1,  .  .  .  , |  -  1.  Since  this  is  also  true  for  .  fc  1 . 1  1 . 

the  corollary  is  proved. 
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Unfortunately  the  fact  that  c”  *  in  Problem  13  depends  on  L  makes  it  im¬ 
possible  to  extend  the  results  of  Theorem  2  to  the  general  n- stage  problem. 
For  in  this  case  the  Lagrangian  solution  of  Problem  10  will  yield  a  Ts*  that 
depends  on  <  for  the  same  reason  that  the  coefficient  c"~k  in  the  objective  func¬ 
tion  of  Problem  13  depends  on  ' . 

However,  the  following  theorem  can  be  proved.  An  alternative  and  some¬ 
what  simpler  proof  is  given  in  App  B. 


Theorem  4 

If  none  of  the  constraints  P(X,  4  0)  •  4(t  j  - 1,  .  .  .  ,n  in  Problem  3  are 
tight,  then  for  each  i ,  /  1,  .  .  .  ,n ,  ij*  defined  in  Theorem  3  can  take  on  only 

one  ol  the  three  values  V(!,  or  **,  or  T*  ,  where  V,/ ,  wj,  are  defined  as  in 
Theorem  2  and  >  T1*  »  Wf!  for  all  '  ( l',_l  . 

Proof.  Suppose  the  constraints  P{X,  j  0}  ?  /S,,  |  =  1,  .  .  .  ,n  are  not  binding 
in  Problem  3.  Then  the  sign  of  X*  in  any  set  AjT  ,  need  no  longer  be  of 

concern.  In  particular,  in  Problem  5  the  additional  constraint  that  Xs  ^  0  if 
'  e  I'  and  Xs  •»  0  if  >  c  J '  is  not  needed. 

Thus  in  the  proof  of  Theorem  1  the  change  of  variable  Xs  =  Z'~  need  not  be 
made  since  the  sign  of  Xs  in  Ap-  can  be  allowed  to  change.  Again,  using  varia¬ 
tional  theory  gives  in  place  of  Eq  7  that  jll  Xs  -  0  implies 


\: 


1 

N 

|“l 


(7a) 


Thus  only  Eq  8b  can  hold  and  hince 


\| 


1 1, 


(14) 


in  each  A*,-1  . 

Theorem  2  can  then  be  proved  as  above. 

Again  Theorem  3  is  seen  to  hold  for  I  =  1  and,  assuming  it  is  true  for  t  ~k, 
the  effect  of  X* _ b , ,  ,  .  .  .  ,  X*  on  the  objective  function  of  Problem  13  is  to  make 
c"~k  independent  of  (  ,  (i.e.,  c"_k  =  i"_fc  for  all  where  c"~k  is  a  constant). 

This  is  true  because  Eq  14  implies  that  \^,|  1,  .  .  .  ,n  is  strictly  linear 

in  X„  j.,  not  piecewise  linear  as  it  was  in  the  previous  case.  Hence  in  Eq  11, 
summing  is  over  jill^  tfi’1  *,  and  hence  the  first  term  of  expression  12  can  be 
written  in  the  form 


where  the  sum  of  the  integrals  over  all  A*.-1  has  been  dropped  and  replaced  by 
an  integration  over  Q(_, ,  since  it  is  known  that  Q,_,  i ,  Vi-i  A(r  .  But  in  this 
case  when  integration  is  performed  with  respect  to  b, ,  .  .  .  ,b,_,  the  resulting 
value  of  the  integral  is  1,  since  the  integration  is  performed  over  all  possible 
values  of  these  random  variables,  not  just  some  of  the  values  as  in  the  proof 
of  Theorem  3.  Hence,  in  place  of  expression  12a,  there  is  obtained 

M  —  K* 

1  I.  ...  I  . dh,  ,  . 

.  -  I  11  1-1 
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where  c,  is  a  constant. 

This  means  that  the  problem  that  must  be  solved  to  determine  X*_fc  is  the 
same  as  Problem  4  with  s  -n-fc  and  cs  -  c"-b.  Thus  Corollary  1  can  be  used  to 
find  X^_k,  and  hence  Theorem  4  is  shown  to  be  true  for  t  -  k  f  1. 

Thus  the  theorem  is  proved  by  induction. 


5.  AN  EXTENSION  OF  THE  RESULTS 


In  this  section  an  extension  of  Theorem  3  is  established.  Suppose  that 
c, ,  i  =  l,  .  .  .  ,n  are  continuous  random  variables.  If  f,  f,  (b,,  .  .  .  ,b, ,  c{, 

.  .  .  ,c,)  =  the  joint  frequency  function  of  the  random  variables  b|t  Cj,  j  =  1,. . .  ,i , 
if  it  is  assumed  that  f„  is  a  known  frequency  function,  and  if  X,  X, ( b , ,  .  .  .  ,b,_,  , 

Ci,  .  .  .  ,c,_i);  then  Problem  2  becomes 
maximize 


V. 


1-1 

n  ii(  b.  )  <i  (c  ) 
k«l  * 


subject  to 


•.(in 


a.  i  •  I 


P<\(  >0)  2  pr  i  -  i . n. 


where  Q,_,  is  the  closure  of  the  set  in  2(i  - 1) -dimensional  Euclidean  space 
where  f,_,  >  0,  and  c  is  the  conditional  expectation  of  c,  Riven  bk,  c*,  k  =  1, 

- i-i. 

Then  it  can  be  established  that  Lemma  1  continues  to  hold,  only  now 
{A|-1,  is  a  set  of  2(s  - 1) -dimensional  rectangles.  Theorem  1  is  also 

true  in  this  case,  except  that  -fs  ass  is  no  longer  a  constant  but  rather  a  func¬ 
tion  of  the  conditional  random  variables  involved  in  cs. 

Thus  Problem  9  is  no  longer  a  problem  in  determining  a  constant  T(  but 
rather  one  of  finding  a  function  ,  and  hence  the  Lagrange  multiplier  technique 
used  to  establish  Theorem  2  will  not  work. 

However,  Theorem  3  can  be  proved  just  as  was  done  above  by  replacing 
cj I  by  Cf  .  Thus  the  following  result  has  been  established: 

Theorem  5 

If  in  Problem  3  it  is  assumed  that  c, ,  b, ,  i ,  i  are  continuous 

random  variables,  then  X*,  j=  1,  .  ,  .  ,n  is  a  piecewise  linear  function  of  u;, 
and  r.-HT** ),  i  =  1,  .  .  .  ,t,  where  T,1.  is  a  function  of  bu  .  .  .  ,bt_,,  c,,  .  .  .  ,c,_ , . 

This  is  the  specialization  of  Theorem  2  in  our  previous  paper1  to  the 
triangular  case. 


6.  INDEPENDENT  RANDOM  VARIABI  ES 

Return  again  to  the  problem  considered  in  Sec  2,  in  which  the  c, ,  i  1, 

.  .  .  ,n  are  constants.  Also  introduce  the  additional  assumption  that  the  random 
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e 


variables  b, ,  i  -  1,  .  .  .  ,n  are  mutually  independent.  Let  /,(.),  and  F,  (.),  i  =  1, 

.  .  .  ,n  represent  the  frequency  function  and  the  distribution  function  respec¬ 
tively  of  the  continuous  random  variable  b,,  i  -  i,  .  .  .  ,n. 

In  this  case  several  extensions  of  the  previous  results  are  immediately 
available.  First,  owing  to  the  assumption  about  the  independence  of  the  b, , 
fs(-)  fs(-)J  hence  fsl(T*)  defined  in  Corollary  1  equals  f  j *( T^*) ,  which  is  a  con 
stant,  i.e.,  not  a  function  of  any  b, .  Moreover,  using  the  definition  of  y*  and 
the  fact  that  Fs  L  ]  =  Fs  if  s ‘(T,?* )  J  is  independent  of  bi,  .  .  .  gives 

FSL['-‘(T/*) ]  Fs_,(/^-1)  -  y\  for  't\  and  >( ).  This  implies  that 


where  Djf  is  some  constant  iti  [0,1]. 

Using  this  definition  of  Fs_‘( Dp* )  permits  replacement  of  )  by 

F"'(Dp*)  in  property  vi  of  { Ap~ ',  which  was  defined  following  Theorem 

Thus  the  equivalent  of  Problem  9  is 
maximize 

{,.7, 


subject  to 


'-1  a 

-  —  i  I  ....  f  i.  —  V,  *  —  fs  ,  db,  .  .  db  . 
t’< i.j  * J  A»-r  i ~ 1  a.s  '  “»  s“*  1  s-' 

r  L  j 


i.  1 )  i  i  -  \  . 

(«i,i 


»;  -  u>(\(  .  A  .,11  Ib, . dnd  M. 

d(;  _  uS)\(  .  „Nj.  uii  ib, . b s t > * aj: ~ 1  «n<i  r.j 


o  .  d(:  _  i .  aii  r .  I  I5d; 

It  is  clear  that  Dsp*  are  the  optimal  Df  for  Problem  15. 

In  solving  Problem  15,  15b  and  15c  constraints  can  be  replaced  by 
constraints  of  the  form 

l)(',  .  .  for  I-.I  .  (16) 


and 

»V-  »>?-''  •  f',r  r'J  •  (17) 

where  kjT1  is  a  constant  that  depends  on  Ap~l. 
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Since  these  constraints  give  bounds  on  Dp,  Problem  15  can  be  written  in 
a  form  similar  to  Problem  10.  This  problem  is  then  solved  with  the  result 
that  Dp*  can  take  on  only  one  of  the  three  values,  0,  1,  or  Dst ,  where  0  <  Ds  <  1. 
This  is  the  analog  of  Theorem  2. 

If  is  replaced  by  F~‘(Dp  ),  the  results  of  Theorems  3  and  4  can  be 

obtained  just  as  they  were  in  Sec  4,  only  now,  in  Theorem  4,  Dp  can  take  on  only 
the  values  0,  1,  or  D1*  for  j  1,  .  .  .  ,n. 

Let  I,  =  [ ' :  D1*  =  J'*  for  tri.1*-1}. 

Let  l2  -  D'*  0  for  'c  i1'-1}. 

Let  1 3  -  { '  :D'*  =-  1  for 

Then  when  Theorem  4  is  applicable  (i.e.,  when  the  constraints  P ( X,  -  0)  ^ 
fj  ,  |  1,  .  .  .n,  are  not  binding), 


p  i  i. . . .  i  (-  'l*  — . 

i.l,  1  \  1  an  “i, 

•  x  i ....  i  ^  ’  u,fc  -  -- 

l.i,  v.-i  \  1  ‘'u  “u 


i  ~  id 


I  Jh,  .  .  dl>,_, 


.  I~'UM 


,dh,.  .  . 


1  I  .  .  .  . 

‘*1,  - 1 


I- I  n.,.  ■ ' 

i  —  -  ~ 

*  1  u 


f  r  " 1  f, .  ■  ji> 


- 1 


-  i.i/-  1  >. 1  —  \  i 

I.  <1  .Ij.l)  V[- 1  \  k  ■  1  %  Uii  / 


I  tJ  h  j  .  ti  f> ,  _  j 


r,- 1  <»)'*  >  i  r,  .  (  a' -* »  .  f  _  *  (oi  v  r,  ,  <  \.t  - 1 »  •  i 1  ■  n  x  r  ,  *  1  • . 

f  i’  |  I  '  t  J  Vi  1  *“ 1  (  i  i<  ,  ’  —  *  t 


r,ii 


i.i. 


However,  it  is  known  that  Q(^,  i*,-,  A}"1  and  that  I ,,  |2,  | ,  partition  the 

set  of  indexes  '  fV,-\  Thus  the  first  term  in  this  expression  does  not  depend  on 
the  choices  of  A'-1.  In  other  words  this  first  term  is  known  when  Xj  ,  k  1, 

.  .  .  1  and  is  independent  of  the  choice  of  {A}."1  ,  ffV’~  }  and  l)1*.  Moreover, 

using  the  expression  for  X  , 


I  J  f>  |  .  .  J  h  (  _  | 


IV  X  /  (  ,  i  \J.~  1 
I  .  I, 


*  t 


r  -  I  ' , 


-1  , 


Hence,  when  the  constraints  P(X,  <:  0)  a  0(,  |  =  1,  .  .  .  ,n  are  not  binding,  to  find 

the  [A’p  1  ,  and  IV*  only  this  problem  needs  to  be  solved: 

maximize 

i  1 1 1)1 1  i  /  _ ,  i  \ 1  - 1  >  .  f  ~ 1  mi  x  i  <\;.  ’i  .  i  ~ 1 1 1 1  x  i  .  \  'i 

1  i, 1 1  1  1  i.i,'  i.i,  1 
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subject  to 


o'  l  r,  i  v'-'i  .  i  f  <  \l~‘  i  _  i  - 

( >  i  1  ■ 


f*  i . 


o  D1  i  .in.!  i.  r  .  <  t  [r 1 1  i  . 

t .  i ! .  i , .  i ,  1  1 


18) 


Now  see  that  by  defining 


if.  1 i  . 


i 


if.  .  '  \ 


I  .  I 


'  I  -  I 


-I  , 


-I  . 


and  assuming  D1*  is  known,  Problem  18  can  be  written  as 
maximize 

rr‘ '•)" “’i,  -  r-'.oti.j, .  r-'iix.,, 


subject  to 


O'-o,,  .  (,„  -  i-  ,, 


(19) 


<•„  -  "•  ' 


Problem  19  is  a  linear  programming  problem  in  G()  ,  i  -  1,  2,  3.  Since  there 
are  three  variables  and  only  two  constraints,  it  is  known  from  the  theory  of 
linear  programming  that  at  the  optimal  solution  at  least  one  of  the  G,,  =0, 
i  =  l,2,  3.  Noting  that  F~‘(0)  Ff1!^*)  •»  Fj"‘(l)  as  0  -i  D1*  -  1  and  that  Ffl  is 

a  nondecreasing  function,  it  can  be  seen  that  at  the  optimum  G^  =  0. 

Moreover,  the  first  constraint  of  Problem  19  must  be  satisfied  as  an 
equality  at  the  optimum;  otherwise  D1*  could  be  increased,  thus  increasing  the 
value  of  the  objective  function  and  so  contradicting  the  assumption  of  optimality 
of  D1*.  Therefore  it  may  be  found  from  the  constraints  of  Problem  19  that 


<  >  I*  -  - —  ami  <i>* 

■  l  |_|)l-  >1 


'  i 

I  -I)'  ‘ 


(20) 


are  the  optimal  values  of  G,,  and  Gl(  respectively.  These  give  expressions  for 
the  optimal  Gl( ,  i  1,  2,  3  in  terms  of  D1*. 

It  remains  to  determine  D1*  by  solving 
maximize 


subject  to 

»  I)1  •-  (21) 
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by  solving  this  nonlinear  programming  Problem  21,  D1*  is  obtained,  and  by  using 
Eq  20,  G'*j  and  G*  are  obtained.  Thus  V*  has  been  obtained  explicitly  for  the  case 
where  Theorem  4  is  applicable  (i.e.,  where  the  constraints  l’(\,  •  0)  -  0, ,  |  1, 

■  ■  ■  ,n  are  not  tight),  and  the  random  variables  are  independent. 

Moreover,  this  entire  development  did  not  depend  on  Xj,  k-  1,  .  .  .  ,j  -1 
since  Problem  18  does  not  explicitly  involve  the  decision  rules  of  the  preceding 

periods.  Thus  the  results  on  \*  are  valid  for  all  i ,  |  1 . n,  and  hence 

Theorem  6  has  been  proved. 

Theorem  6 

If  the  constraints  I*  \,  _•  O'  0,,  |  =  1,  .  .  .  ,n  are  not  tight,  and  if  the  ran¬ 
dom  variables  b, ,  i  1,  .  .  .  ,n  are  mutually  independent,  then  the  optimal  de¬ 
cision  rules  for  Problem  3  are  given  by 

V  1 - -  - l  1  i)  ‘  .  in  \  1 

1  1  I  ><M  11  1 

where  D1!  is  either  1  or  f)1* ,  and  {  Vf 1  ,  ' ei"1  11  are  any  sets  for  which 

Q,_,  V,  Vi-  *  'r "*  and  that  satisfy  .  Ft  (  \'f  '  )  <»  T,  and  Si,  F,  ( -V,  1  )  (if,.  More¬ 

over,  Hi*  is  found  by  solving  Problem  21,  and  G*  ,  G T,  are  obtained  from  Eq  20. 

Thus  it  has  been  shown  that  Problem  3  can  be  reduced  to  a  problem  of 
solving  (i  rather  simple  nonlinear  programming  problems  of  the  form  of  Prob¬ 
lem  21.  In  particular,  if  each  random  variable  b,  ,  i  -  1,  .  .  .  ,n  has  the  same 
distribution,  then  Problem  21  needs  to  be  solved  only  once  to  obtain  D1*  as  a 

function  of  or,.  This  will  then  give  I)1  ,  |  =  1,  .  .  .  ,n  by  putting  the  corresponding 

o(,  |-1 . n  into  the  expression  for  D^to,). 

It  is  important  to  note  in  this  development  that,  as  implied  by  Theorem  6, 

;  -Vf  ,  '  (  V1  l;  is  not  necessarily  unique.  Indeed,  only  the  optimal  covering  of 
Q,_,  need  be  selected,  subject  to  the  restriction  that  G*  and  G*,  have  their 
required  values.  Thus  the  question  arises  as  to  when  this  optimal  covering 
will  be  unique.  From  Eq  20  it  can  be  seen  that  this  will  happen  only  if  D1* 

1-  a,,  in  which  case  G*,  -  1,  G't,  0,  and  hence  the  optimal  decision  rule  is 


for  all  ( b, ,  .  .  .  ,b,_,)  r Q,_ ,  . 

This  development  also  shows  that  if  G?(  -•  0,  so  that  the  optimal  covering 
of  Q, _ ,  is  not  unique,  and  if  G*(  =  1  j  =  G't(  ,  then,  in  general,  two  optimal  decision 

rules  for  \,  that  do  not  coincide  anywhere  will  exist  in  Problem  3. 

Another  result  that  is  worth  noting  is 

Theorem  7 

If  b , ,  .  .  .  ,b„  are  independent  random  variables,  then  a  necessary  condition 
that  D,'*  1  for  some  'fV'~'is  that 
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and 


^  o  . 


(22) 


This  theorem  can  easily  be  proved  by  using  Lagrange  multipliers  to  solve 
Problem  15.  This  result  is  true  for  the  case  n  2  even  when  the  constraint 
P(.\a  0)  --  pL  is  binding.  It  is  also  true  for  the  n-stage  problem  when  none  of 

the  constraints  P(  V,  0)  -  0,  is  binding.  Thus  we  know  that  G*  =  0  in  Theorem 
6  without  solving  Problem  21  if  Condition  22  is  not  satisfied. 

Again,  considering  Problem  15,  Theorem  8  can  be  proved. 


Theorem  8 

If  the  random  variables  bM  .  .  .  ,b„  are  independent,  then  a  necessary 
condition  that  D,'*  -  0  for  some  feP''-1  is  that  r ~ 1  ( 0)  ■  -  °  and  either  0 

or  fs  F-'(0)  fsl  F" ‘(D1* )  ^ ,  where  kf-'  is  defined  in  constraints  16  and  17. 

This  theorem  holds  for  the  case  n  =  2  even  when  the  constraint  P(  \2  -  0) 

82  is  oinding.  In  RAC-TP-1741,  Theorems  7  and  8  are  used  to  solve  explicitly 
for  the  optimal  decision  rules  of  a  particular  two-period  problem. 


7.  LI' 'EAR  PROGRAMMING  UNDER  UNCERTAINTY 

A  special  case  of  Problem  1  that  has  been  considered  in  the  literature  is 
the  case  in  which  a,,  0,  =  1,  i ,  j  =  1,  .  .  .  ,n.  Such  problems  have  been  named 
“linear  programming  under  uncertainty.” 

The  foregoing  work  gives  the  following  theorem  for  this  special  case. 

Theorem.  9 

Let  a,=  l,i  =  l,...,n. 

Let  0 j  -  1 , 1  -  1 ,  •  .  .  ,n. 

Then  either  \*  =  0,  or 


for  all  points  (  b, ,  .  .  .  ,b,_,)  e  Q, _ 4  - 

Proof.  From  our  definition  of  y *  we  get  >*  =  0  for  all  '  as  a,  =  1  for  all  1 
implies  that  1  -  o,  =  0  for  all  1 . 

r  1  -  _  s  5  - 1 

Therefore  we  must  have  Fs.f-'(T(.  )l  -  0  for  all  points  in  for  Id,  /. 

Therefore  (T,^ )  =  F-‘(0)  for  all  points  in  Ap“  ,  and  hence  the  theorem 
is  proved. 

This  result  is  particularly  important  because  it  illustrates  dramatically 
the  restriction  of  optimal  action  that  occurs  when  the  chance-constrained  pro¬ 
gramming  problem  is  restricted  to  a  problem  in  linear  programming  under 
uncertainty.  It  should  also  be  noted  that  the  linear-programming-under-uncer¬ 
tainty  problem  has  no  solution  for  distributions  (such  as  the  normal  distribution) 
for  which  F- 1  (0) 
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A.  Derivation  of  the  Euler  Equation 


B.  An  Alternative  Proof  of  Theorem  4 
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Appendix  A 


DERIVATION  OF  THE  EULER  EQUATION 


Most  texts  of  the  calculus  of  variations  derive  the  Euler  equation  for  the 
problem 
maximize 


subject  to 

\  a  i  \  .in.i  \ 1 1>  i  it  (23) 

In  order  to  do  this,  they  assume  that  in  u,b  v  ( x >  exists  and  is  continuous 
and  that  all  second  partial  derivatives  of  (i(.)  exist  and  are  continuous.  They  do 
not  consider  the  case  in  which  (i(.)  is  not  a  function  of  v'(x)  and  so  do  not  dis¬ 
cuss  what  weaker  conditions  of  continuity  and  differentiability  of  (>'(x,y)  are 
sufficient  to  obtain  the  Euler  equation  for  this  problem.  Hence  a  derivation  of 
the  Euler  equation  for  this  special  case  is  presented  here. 

Consider  the  problem 
maximize 

i  i  t.  \ !  i  ) ./ 1  .  ( 24) 

where  it  is  assumed  that  (.  .-y  exists  and  is  continuous  in  _u,b  .  and  that  v  ( x  ) 
is  continuous  in  La,b_. 

Let  J  (y)  Jj’d.  x ,  y  ( x ) .  <i  x  . 

Let  v  (x)  give  a  relative  strong  maximum  to  /  (y),  i.e.,  J  (v)  1  (  v)  for  all 

v  such  that  |v(x)-  (y)|  <  f  for  all  x  in  _u,  b.  and  some  c  ■  0. 

Let  v ( x )  v  ( x )  +  rf(i)  be  any  other  continuous  curve  such  that  |v(x)  -  v(x)|- 
(  for  all  x  in  _u,  b. . 

Let  0(c)  J  (v  *■  f  f ). 

Then,  since  v  is  an  extremum  for  J  (y ),  d0(c  )  d  r  ]f  „  =  0,  i.e. ,  p  '(0)  0^. 

But  0(f)  J’tffx.y  •  f f ) d x ,  so  that  o'(0)  ^(Aifx.v)  vjf(i)di  0,  which 

by  the  lemma  of  Lagrange  (see  Akhiezer11)*  implies  that 

-  — -  U  f,  .r  ,il  I  i  in  ^ij  .  bj  (25) 


‘Sec  also  Bateman'  fur  a  more  complete  discussion,  including  Haar’s  lemma. 
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Hence  Eq  25  is  the  Euler  equation  for  Problem  24,  and  the  existence  and  con¬ 
tinuity  of  j (i  jy  is  a  sufficient  condition  for  the  derivation  of  Eq  25. 

The  extension  of  Problem  24  to  multiple  integral  isoperimetric  problems 
can  be  achieved  as  it  is  in  most  texts  of  the  calculus  of  variations.  Hence 
Problem  5  requires  that 


exist  and  be  continuous  in  Ap~‘.  This  is  assured  by  the  definition  of  A5)'1. 

It  is  interesting  to  note  that  no  end-point  conditions  exist  on  y  (i)  in 
Problem  24  as  in  Problem  23.  This  is  because  the  Euler  equation  (25)  im¬ 
plicitly  defines  y(i),  and  hence  arbitrary  end-point  conditions  would  make  the 
problem  inconsistent.  In  the  terminology  of  the  calculus  of  variations  there 
are  the  “natural  conditions”  at  the  end  points  in  Problem  24.  This  is  also  the 
case  in  Problem  5. 
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Appendix  ft 

AN  ALTERNATIVE  PROOF  OF  THEOREM  4 


In  Theorem  4  it  is  shown  that  the  results  of  Theorem  2  could  be  extended 
to  the  complete  n -period  model  If  it  is  assumed  that  the  constraints  P(Xj  0j), 
l  1,  .  .  .  ,n  are  not  binding.  In  this  appendix  a  different  and  somewhat  simpler 
approach  is  used  to  establish  Theorem  4. 

Problem  1  can  be  written  in  the  form 
maximize 

,-,‘t  J  ■  ■  ■  ■  l  \ 

subject  to 

’  I  •  •  •  •  J  f,  |  Xt  '  "■’)  f.-ldbl-  ■  • tib.  - 1  -  '  ’  1 . "■ 

IM\|  -  O'  /i (  |  -  I . n  . 


Now  suppose  that  the  constraints  P ( X,  ■  0)  s  d,,  I  =  1,  •  •  •  ,n  are  not  binding 
in  Problem  26.  Let  u,  ,  i  =  1,  .  .  .n  by 


Then,  by  inverting  these  equations  to  get  X,  as  a  function  of  u, ,  i  =  1,  .  .  .  , 


-  - 


u  , 


""I 


a 


11 


Uj(hj)  j 


a., 
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u,,  -  1  1 


|  1  a  j| 

u.,> 


1 

UH  J 


I 


“.’2 


M.»  (  h  |  ) 


25 


or,  in  general, 


. . h,-i>  -  (bi . b,_i> 

4  i  U,,(b . hi) .  1-1 . M.  (27) 

i- 1  J,  11  11 

where  the  rl(,i  ,  j  -  1,  .  .  .  ,n  are  constants  that  depend  on  the  a(|  and  d,  . 

Putting  Eq  27  into  Problem  26  and  ignoring  the  d,  constraints  shows  that 
Problem  26  is  equivalent  to 
maximize 


H 

\ 


.  I 


.  .  <1  h 


i-l 


subject  to 

**»  <d.)  r,  («(<b, . •  dh,_,  <.1-1.  .  • 

This  is  equivalent  to 


(28) 


ri  I  r 

V  V 


f i  ,“|  V‘T  - 1 J  h  I  * 


maxinme 


- .  i - 1  -  *,r,iM,f|-idhi-  dh,-i 

)  >>  I  I  «  I  1,1 


subject  to 


«d(>  / - /F,<«l>fI_1db|.  .  .dh,_,  -  a;.  1-1 . n.  (29) 


In  transforming  Problem  28  into  Problem  29,  the  region  of  integration 
was  changed  from  Q,_,to  Q,_,.  This  was  done  by  first  observing  that  in  the 
objective  function  of  Problem  28  u,  is  being  integrated,  and,  in  our  enumeration, 
i  i  .  Now  if  i  >  j  ,  the  term  c,r(|ii|  (b,,  .  .  .  ,b,_,)  can  be  factored  outside  the 
integral  sign,  and  the  integration  of  f,_,  can  be  performed  with  respect  to 
b, ,  b,,,,  .  .  .  ,b,_,.  This  means  that  integration  is  being  performed  over  all 
possible  values  of  these  random  variables.  Hence  the  value  of  this  integration 
is  1,  and  integration  must  be  performed  over  Q,_,  . 

However,  Problem  29  is  now  separable  into  the  following  n  distinct  and 
unrelated  problems  of  determining  u,,  )  1,  .  .  .  ,n,  viz, 

maximize 


subject  to 

"K"  (V  / - /F, <«,> Jl»| .  .  «*•*,_,  -  .  (30) 

Since  Problem  30  is  a  special  case  of  Problem  4,  we  can  proceed  to  solve 
Problem  30  just  as  Problem  4  was  solved.  Establish  that  a  necessary  condition 
that  u*  maximize  Problem  30  is  that  there  exist  a  covering  of  Q  ,,  say 
{  4,_  ‘ ,  t  (  i’,_  1  ] ,  such  that  u*  =  ffH  )  in  A1/- ' ,  V*“ 1  ,  where  T|‘  can  have  only 

three  possible  values:  V,,1  ,  ,  or  Tr* . 
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If  it  is  now  assumed  that  the  random  variables  are  independent,  Dj.  can  be 
defined  as  was  done  in  Sec  6  and  the  optimal  D1  and  Ap  can  be  found  as  was 
outlined  in  the  development  preceding  Theorem  6.  Thus  u*  is  determined. 

Since  this  can  be  done  for  each  i ,  |  1,  .  .  .  ,n  in  Problem  30,  u* ,  j  =  1, 

.  .  .  ,n  can  be  found.  Substituting  these  expressions  into  Eq  27, 


*  i.'  —  V*  -  —  Ci,  ♦  F,-l  (I)!*)  in  A'-1, 
I- 1  «„  1  '  '  f  1 


which  agrees  with  the  previous  results. 
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